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ASYMPTOTIC THEORY OF LEAST SQUARES ESTIMATORS FOR 
NEARLY UNSTABLE PROCESSES UNDER STRONG 
DEPENDENCE 

By Boris Buchmann and Ngai Hang Chan 
Australian National University and Chinese University of Hong Kong 

This paper considers the effect of least squares procedures for 
nearly unstable linear time series with strongly dependent innova- 
tions. Under a general framework and appropriate scaling, it is shown 
that ordinary least squares procedures converge to functionals of frac- 
tional Ornstein-Uhlenbeck processes. We use fractional integrated 
noise as an example to illustrate the important ideas. In this case, 
the functionals bear only formal analogy to those in the classical 
framework with uncorrelated innovations, with Wiener processes be- 
ing replaced by fractional Brownian motions. It is also shown that 
limit theorems for the functionals involve nonstandard scaling and 
nonstandard limiting distributions. Results of this paper shed light on 
the asymptotic behavior of nearly unstable long-memory processes. 

1. Introduction. Consider a first-order autoregressive model, 

Xt = (iXt-i + Et for t e N, Xo = 0. 

The parameter /? is unknown and has to be estimated from the observations 
Xi, . . . Whenever e = {stjn is a sequence of independent standard nor- 
mal random variables independent of Xq both the least squares estimator 
and the maximum likelihood estimator for /?„ are given by the formula 



bn{XQ^ . . . , Xn 
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For < 1 (stationary regime), Mann and Wald [18] showed that 

/n-l \ 1/2 

(1.1) fn= VxM (bn-P)^Wi, n^cx), 



where Wi is a standard normal random variable and denotes convergence 
in distribution as n ^ oo. For the explosive case > 1, (1.1) holds only 
when e is a sequence of independent standard normal random variables; 
see Anderson [1]. In general, if e does not form a sequence of identically 
distributed and independent random variables, a limit distribution for fn 
may not even exist. On the other hand, (1.1) fails to hold for P = 1 even 
when £ forms a sequence of independent standard normal random variables. 
Surprisingly, the limit distribution of f„ does exist, but is not normal. White 
[30] and Rao [21] showed that it is a functional of Brownian motion W = 
{Wt)o<t<i, that is. 



(1.2) f„4r = l[W^f-l][/ 

Jo 



W^ds 



-1/2 

, n — > oo. 



This contrast between (1.1) and (1.2) is an example of a critical phenomenon. 
The parameter value f3 = 1 comprises a singularity and there is a lack of 
smooth transition of the limiting distribution of fn when (3 is close to one. 
In particular, for finite sample analysis or tests under local alternatives, a 
key question becomes that if /3 is close to one, what kind of approximation 
should be used for f„? An answer to this question is given in Chan and 
Wei [4], where a class of nearly nonstationary models is proposed. In the 
econometric literature, such a class is also known as the near-integrated 
time series; see Phillips [20]. In a spectral setting, Dahlhaus [5] consider 
tapered and nontapered Yule-Walker estimates of near-integrated models. 
Let n E N and consider 

(1.3) X^""^ =(3nX^l\+et for t = l,...,n, 
where is an initial value. 

Theorem 1.1. (i) Let Xq"'^ = 0, almost surely, for all n G N. Suppose 
that £ forms a sequence of martingale differences such that for oo 

1 

(1.4) -Y,E[e^,\J^t-i] = l + op{l), 
1 " 

(1.5) -Y,E[et^\e,\>n^/^a\^t-i] = op{l) for all a > 0, 

t=2 

where Tt = cr{es :0 < s <t). 
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If there exists 7 € M such that /3„ = 1 — 7/n, then 

Tn^r{-f) = " =, n^oo, 

where Wy^t = Wt - 7/0 e'^^^'^'^Ws ds, t G [0, 1]. 
(ii) To = f and C{f.y) C{Wi) for \j\ 00. 

Model (1.3) was later explored by Jeganathan [14, 15], who generalized 
the near-integrated notion to a general AR(p) case. In practice, econometric 
and financial time series often exhibit long-range dependent structure (see, 
e.g., Robinson [22, 24] and Doukhan, Oppenheimer and Taqqu [11]) which 
cannot be encompassed by the martingale difference setting of Chan and 
Wei [4]. 

In this paper we are concerned with least squares estimators when long- 
range dependence in the innovation is present. We investigate the behavior 
of the transition of the limiting distributions of the least squares statistic 
f„ when (3 is close to one, something similar to (1.1) and (1.2). We apply 
our results to noise sequences e with corresponding partial sum processes 
lying in the domain of attraction of fractional Brownian motions. Under 
this setting, we investigate the behavior of the transition of the limiting 
distributions. Although a formal analogy will be developed, as will be seen, 
the techniques and the proofs involved are very different between the long- 
range and short-range dependent cases. In particular, our theory relies on 
making use of the fractional Ornstein-Uhlenbeck processes. 

It should be pointed out that there exist other methods for dealing with 
long memory models, notably the Whittle estimates, the tapered Whittle 
estimates and related semiparametric procedures that were discussed in Ve- 
lasco and Robinson [29] and Robinson [24] . For further details and properties 
about these methods, we refer the readers to these papers and the references 
therein. The semiparametric approach constitutes an important alternative 
to ordinary least squares (OLS) as its origin stems from a basic whitening 
idea, which could be argued to be one of the major goals in modern time 
series analysis. Another important advantage of the semiparametric proce- 
dure is that their estimators are usually asymptotically normal and thus 
standard limit theory can be applied so that optimality properties and rel- 
ative neatness can be attained, albeit the computationual burdens of these 
estimators are usually heavier than those of OLS. 

This paper is organized as follows. In Section 2 main results are given. 
Proofs of the main results are given in Section 3 and conclusions are given 
in Section 4. 
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2. Main results. 

2.1. Limit distributions of ordinary least square estimators. In consider- 
ing possible noise sequences e, we shall impose sufficiently nice asymptotic 
properties of the associated partial sum processes. Let D be the space of 
cadlag functions / : [0, 1] ^ M equipped with the Skorokhod topology. As a 
measurable structure on D we consider the corresponding Borel fi-algebra 
B{D). We write X„ -^u X whenever X„, X are random variables taking val- 
ues in (D, B{D)) such that Xn converges weakly to X in D as n—f oo, that is, 
lim„,_»oo -E'/(^n) Ef{X) for all bounded continuous functions / : D — > M 
(see Billingsley [2] for details). 

We subsume our assumptions on e into the following definition of domain 
of attraction. 

Definition 2.1. Let G = M+ U {0} and a = {an)nm ^ ■ 

(i) We write {e,Z) G DA(a) whenever e = (efc)fceN is a sequence of ran- 
dom variables and Z is a random variable taking values in {D,B{D)), satis- 
fying the additional properties: 

1 d 

(Dl) — ^Ek^oZ, n^oo. 

k=i 

(D2) P(Z(t) =0 Vt€ [0,1)) = 0. 

n 

(D3) Y.4 = opial), n^oo. 

k=l 

(ii) We write {e,Z) G DA'(a,cr^) whenever e = (efc)fcgN is a sequence of 
random variables and Z is a random variable taking values in (D,B{D)), 
satisfying (Dl) and (D2) in (i) and, in addition, 

1 " 

(D3)' -^el = a'^ + op{l), n^oo. 

^ k=i 

To state a result on ordinary least squares procedures, let Z a random 
variable taking values in (D,B{D)). Additionally, if Z satisfies condition 
(D2) of Definition 2.1, then a random vector Q{Z) is well defined where 
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We define the Ornstein-Uhlenbeck process = (-Z'-y,t)te[o,i] driven by Z by 
setting 

(2.7) Z^,t = Zt-j f\-^^'-'^Zsds, te[o,i],7eM. 

Jo 

Clearly, Z^ is a random variable taking values in {D,B{D)) if Z has this 
property. Additionally, note that (D2) is satisfied for random variables Z 
taking values in (D,B{D)) if and only if, for all 7 € M, the same is true 
for the corresponding Z^. In this case, @{Z^) is well defined. Now we are in 
position to state the main result of this section (cf. Section 3.1 for its proof). 



Theorem 2.1. Leta'^eU-Q and a= {an)neN ^^'^ ■ 

Lei 7 G M and {(3n)neN ^ ^ satisfy lim„^oo n{l - /3„) = 7. Let (X^"^).„eN 
be a sequence of random, variables satisfying Xq^^ = op{an) for n —> 00. As 
defined in (1.3), for n>\, let X^") be the corresponding nearly unstable 

(n) 

model associated with /?.„ and e with initial condition Xq . 
Then the following assertions hold: 

(i) // lim.„_»oo n^^/'^an = 00 and {e, Z) G DA(a), then for n - 

(ii) // lim„,_>oo ?T-~'^^^fln. = 1 and {e,Z) (^T>A'{a,a'^), then for 



00 



00 



Tn 



+ 7^ 4^dsje(z^ 



n{hn - Pn 

(iii) // lim„,^oo ?^~^^^^^n. = and (e, Z) € DA'(a, cr^), then for n — > 00 



ibn-Pn)J ' 2®^^-^^- 

Remark 2.1. (i) Note that Zq = Z. For sequences (/3„) C R with 
lim„,_»oo "-(1 — /3n) = the nearly unstable model behaves asymptotically like 
the strictly unstable one = 1). We may simplify the limit distributions 
in (i)-(iii). For instance, for lim„_»oo ?^~"^^^fln = co and {£,Z) G DA'((a„)„) 
we obtain that 

(ii) For comparison of power functions of unit root tests, it is important to 
derive the asymptotic limit distributions under local alternatives of the form 
/3n = 1 — 'j/n (Tanaka [27], Chapter 9). In particular. Theorem 2.1 offers a 
first step in this direction. 
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Remark 2.2. Let e = {ek)keN be a sequence of martingale differences 
satisfying (1.4) and (1.5) of Theorem 1.1. By virtue of Theorems A and B 
in Chan and Wei [4], we have {£,W) £ DA'((n^/^)„gN, 1), where W is the 
Wiener process (Hah and Heyde [13], Theorem 2.23). As is the pathwise 
solution of the Langevin equation, that is, almost surely, 

dW^,t = -lW^,t dt + dWt, W^,o = 0,te [0, 1], 

it is easy to see by means of Ito's formula that, almost surely, 

W"^ - 1 /•! /•! 

(2.8) +7/ W^,ds= W^^udWu. 

^ Jo Jo 

Combining this identity with the fact that {e,W) G DA'((n^/^)„gN, 1), we 
note that Theorem 1.1 (i) is by now a consequence of Theorem 2.1(ii). 



Remark 2.3. Let (3i > 2 and (32 > and e = {£k)k£N be a sequence of 
random variables with mean zero. Additionally, suppose that 
00 and L'^ = lim.n^oan~^ E{J2k=i^k)^ exists in (0, cxd). 

As shown by Phillips [20] , if e is strongly mixing with mixing coefficients 

am satisfying J2'k^=i'^m'^^^^ < 00 (cf. Hall and Heyde [13], page 147, for 
the definition of mixing coefficients), then we have the result that o"^ = 
lim.„_oo"-~"^Efc=i-E^^fc exists in (0,00) and {e,LW) € DA'((n^/2)„gN, cj^). 

By the same calculation as in Remark 2.2, Theorem 1 in Phillips [20] 
follows from Theorem 2.1(ii), namely, for n — > 00, 



n{hn-Pn)j V 2 



+ 1 {W^,s?ds^diB.g{L,l)Q{W^) 



+ W^^s dW^ diag(L, l)Q{W. 



1) 



2.2. Applications to fractional integrated noise. In this section we ap- 
ply Theorem 2.1 to fractional integrated linear filters. We will restrict our 
analysis to limit processes Z that are multiples of a fractional Brownian 
motion. 

Let H G (0,1). A centered Gaussian process = {Bl^)teR with almost 
surely locally Holder continuous paths of any order strictly smaller than H 
and covariance function 

(2.9) EBf^B^ = l{\t\'^" + \sf" -\t-s\'^^), s,tGM, 



is called a fractional Brownian motion (FBM) with Hurst index H. The 
choice H = 1/2 relates to the Wiener process W. 
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For H £ (1/2, 1), FBM inherits long-range dependence in its increments, 
formally, 

oo 

Ei?(i?f-B,^i)Bf = oo. 

t=l 

We refer to Samorodnitsky and Taqqu [25] and Marinucci and Robinson [19] 
for further properties and discussion. 

Sequences e with partial sums in the domain of attraction of FBM have 
been studied by Davydov [8] and Taqqu [28] and Dobrushin and Major [10]. 
For more modern approaches and further examples, the interested reader is 
referred to Davidson and de Jong [7], Davidson [6] and Wu and Min [32]. 
We shall restrict our discussion to fractional integrated linear filters with 
i.i.d. innovations. 

To this end let = {^k)k&z be an i.i.d. sequence of random variables with 
E^Q = 1 and E^q = 0. Let a = {ak)keNo ^ M be a deterministic sequence 
satisfying 

oo 

(2.10) 5]lafcl<oo. 

k=0 

Let r] be the linear filter generated by ^ and a, that is, set 

oo 

(2.11) Vt = Y.'^k^t-k, t€Z. 

k=0 

For H G (0, 1) we define a sequence of variables = (ej^)tgN by setting 
= {I-By/^~^7]t, t€Z,HeiO,l). 

Here / and B denote the identity and the back shift operator, respectively. 
The interpretation of (/ — i?)~(^~^/2) ig given by the expansion 

oo 

(2.12) = J2bj{H)r]t-j, t € Z, e (0, 1), 
where 

b.(H) = n ^-'^+^-^2 ^ . ^ ^^^^^ 

k=l 

Formally, we have (/ — B)^~^/'^£f = r/t; thus, is called fractional inte- 
grated noise (see, e.g., Brockwell and Davis [3] for an overview and Robinson 
[23] for further discussion about Type-I and Type-II fractional integrated 
noise; note that the parametrization d = H — 1/2 is more commonly used in 
the econometric literature). 
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The sequence is strictly stationary. In view of (2.10) and by means 
of similar calculations as in Brockwell and Davis ([3], page 470), for H € 
(0,l)\{l/2} and t^oo, 



T{3/2-H)T{H+l/2) 



where T{z) = /q°° t^~^e~* dt, z > 0, denotes Euler's T-function and J2'iZo \Er]ir]Q\ 
is finite. 

For H G (1/2,1) and J2iZo Er]i'i]o / 0, fractional integrated noise inherits 
long-range dependence, that is, 

oo 

Y,Ee^e^ = oo, He (1/2,1). 

t=i 

Next we give sufficient conditions such that and a constant multiple of 
satisfy the properties in Definition 2.1 (cf. Section 3.2 for a proof). 

Proposition 2.1. Let a,b>2 and He (0,1). 

Let ^ = {^k)kez be a sequence of zero mean i.i.d. random variables with 
variance one and -E|^o|° < c»- 

Let a = {ak)k&i ^ satisfy Ylk=o'^'k < ^'^'^ 

oo 

(2.13) ^al = 0{n-^), n^oo. 

k=n 

Then J2T=o \'^k\ is finite. If in addition J2T=o'^k / 0, then 

{{e^ )„eN, L{H, a)B'') G DA'((n^)„eN, E[e^f), 

where r] and are defined in (2.11) and (2.12) and the quantities L{H,a) 
and E^Eq)^ are given by 



(2.14) L{H,a) = {T{2H + l)sm{7rH)) 



-1/2 



k=0 



(2.15) 



k=0 



k\ 



H _g-iA|l~2H^;^_ 



Remark 2.4. Proposition 2.1 can be apphed to the famihar ARFIMA 
models. Let H G (0,1). Let ^ = (^fc)fceN admit the assumptions of Proposi- 
tion 2.1. For p, q (zN, let (p and 9 be polynomials of degrees p and q, respec- 
tively. Suppose that the polynomials have no common zeros and all of the 
zeros have modulus strictly larger than one. Then a sequence a = (afe)fc>o 
is well defined by the relation J^k^o^k^^ = (^{z)/4'{z), \z\ < 1. As the ze- 
ros of (j) have modulus strictly larger than one, there exists r > 1 such 
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that a„ = 0{r ") for n oo. Thus, a satisfies the assumptions in Proposi- 
tion 2.1. 

For this choice of a, let tj and be as defined in (2.11) and (2.12), 
respectively. Then rj is the unique stationary solution of (j){B)r]t = 9(B)^t, 
teZ, that is, an ARMA(p, q) model. Furthermore, is an ARFlMA{p, H - 
1/2, q) model (cf. Brockwell and Davis [3], pages 85-87 and Section 12.4, 
resp.). In view of Proposition 2.1, note that 

((ef )nm, L{H, a)B'') G DA'((n^)„eN, E{e^f), 

where we have the simplifications 

L{H,a) 



{T{2H + l)sm{TTH)) 



-1/2 



1 

2^ 



-ik\\ 



ik\\ 



11 -e" 



We will present different representations of the limiting distribution in 
terms of stochastic integrals to highlight some formal similarities to Theo- 
rem 1.1. Note that is not a semimartingale for H E (0, l)\{l/2}. How- 
ever, we may use the following fact: if a, /3 > satisfy a + /3 > 1 and h, g : [0, 1] - 
M are Holder continuous functions of orders a > and /3 > 0, respectively, 
then the integral Jq g{s) dh{s) converges in the Riemann-Stieltjes sense 
(Young [33]). Recall that, almost surely, paths of B^ and, thus, B^^ are 
Holder continuous of any order strictly smaller than H. Consequently, for 
H ^ (1/2,1), almost surely, /q B^,(a;) dSf (w) converges in the Riemann- 
Stieltjes sense. We refer to this mode of convergence as pathwise convergence 
in the sequel. 

We state a direct corollary of Theorem 2.1. In particular, it holds for the 
noise sequences considered in Proposition 2.1. 

Corollary 2.1. Let He (0,1) and L,a > 0. Let j eR and {Pn)neN ^ 
R satisfy lim^^oo n{l - (3n) = 7. 

Let (e,L5^) EDA'((n^)„eN,cT^). Let (xj"^) „gM be a sequence of random 
variables satisfying Xq"'^ = op{n^) forn —> 00. As defined in (1-3), forn > 1, 
let X^") be the corresponding nearly unstable model associated with Pn md 
e with initial condition Xq^\ 

Then the following assertions hold: 

(i) If He (1/2,1), then forn ^00 
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where, almost surely, F^H,^, L,a'^) admits the representations 

(2.16) F{H,^,L,a') = ^iB^^,f + ^l\B^;^j'du = B^^^dB^ , 

and, almost surely, the integral on the right-hand side converges pathwise in 
the Riemann-Stieltjes sense. 

(ii) If H = 1/2, then for n^oo 



n{bn - Pn) 



F(l/2,7,L,a2)diag(L,l)e(H^, 



where, almost surely, F(l/2, 7, L, cj^) admits the representations 

F(l/2,7,Aa^)= ^^'- +7/ Wlds 

(2.17) ' 

Jo 

and the integral on the right-hand side converges in the ltd sense. 
(iii) If He (0,1/2), then for 00 

n^-V2f„ \ , (a/L)2 ^^^^ 



(2.18) ^^,;,(^_-^jA-^diag(L,l)e(i^,,. 

Proof. In view of Theorem 2.1 and Remarks 2.2 and 2.3, it suffices to 
show the second identity in (2.16). Let 7 S M and H S (1/2, 1). 
First note that Bi^ is the unique pathwise solution of 

^^'^ = /J ^7"^" du + B^, se [0, 1] . 

Recall that H > 1/2 and, almost surely, paths of B^ and B^^ are Holder 
continuous of any order smaller than H. For deterministic functions with 
this property, Zahle [34] provides a corresponding chain rule and a den- 
sity formula for Riemann-Stieltjes integrals (Zahle [34], Theorem 4.3.1 and 
Theorem 4.4.2). Consequently, we obtain, almost surely, that 

i «i )2 = i?^, dS^, = £ B^^,d(^-j du + B 

= -7 J\b^,s? ds + J^' dB^, 
which yields (2.16). □ 

Remark 2.5. Let H € (1/2, 1), L,a'^ and e = e-'^ be the fractional inte- 
grated noise defined in (2.12). Suppose that {e^ ,B^) eBA' {{n^ )n, Lh , ajf) . 
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Choosing /?„ = 1, n S N, in Corollary 2.1(i), we may additionally make use of 
Proposition 2.1 to relax the i.i.d. assumptions on rj as imposed in Sowell [26]. 
As a generalization of his result, we obtain 

n{bn - 1) ^ - ,1)' '^ , n^oo,He (1/2, 1), 

where, by now, the underlying process r/ is a linear filter satisfying the as- 
sumptions of Proposition 2.1. Similar to Remark 2.1(ii), the limit in the last 
display remains the same for nearly unstable processes X^""^ whenever /3„ 
satisfies limn^oo'^ll — = 0. A related remark applies to the results of 
Wu [31]. 

Remark 2.6. Stationarity versus nonstationarity. As a possible appli- 
cation, consider the following situation of Remark 2.4 again: 

(1 - = = (1 - t > 1. 

Consequently, X^'") is a nearly unstable ARFIMA(p-|- 1,H — 1/2, q) model. 
For Pn = 1) the results in Corollary 2.1 can be used to test for the presence of 
a unit root in the autoregressive part of ARFIMA models. For = 1 — 7/71, 
Corollary 2.1 gives the limit distributions under local alternatives. Although 
ordinary least squares estimators are easy to compute. Corollary 2.1 shows 
that their limit distributions are rather complicated. For H = 1/2, quantiles 
can be found in Tanaka ([27], Section 7.5). For H ^ 1/2, corresponding 
quantiles would still have to be found by simulation, which is beyond the 
scope of this remark. 

We conclude this section with an interesting link to Malliavin's calculus. 
We shall restrict our discussions to fractional Gaussian noise. To this end, 
for H G (0, 1), consider the noise sequence = {ep)ten defined by ej^ = 

Let 7 G M and (/?„) C M satisfy lim„^oo ^^(1 — Pn) = 7- Extending the proof 
of Theorem 2.1 (cf. Section 3.1), it can be seen that, for n 00: 

n-i (^EF{H,-f, 1,1), H G (1/2,1), 00, 

i=o [^-1/2, (0,1/2), n^cx), 

where F{H,'y, 1, 1) is the quantity in Corollary 2.1(i). 

We compute the expectation EF{H,j, 1,1) for H G (1/2,1). In Corol- 
lary 2.1(i) we have found that F{H, 7, 1, 1) = dB(^ , where the integral 
on the right-hand side converges pathwise in the Riemann-Stieltjes sense. 

For H £ (1/2,1), Duncan, Hu and Pasik-Duncan [12] have developed a 
stochastic integral with respect to B^ in the Skorokhod-Wick sense which 



12 



B. BUCHMANN AND N. H. CHAN 



we denote by Jq i?^^ dB^ in the sequel. Similar to the Ito integral, this in- 
tegral has expectation zero. It turns out that the Riemann-Stieltjes integral 
in (2.16) is related to the Skorokhod-Wick integral via the relationship 

£ dB^ = £ 6B^ + J^' DtBi^^^ du, H G (1/2, 1), 7 G M, 

where D^Bi^,, is a fractional version of the Malliavin derivative (Duncan, 
Hu and Pasik-Duncan [12], Theorem 3.12). 

It can be easily shown that the Malliavin derivative is deterministic and, 
for sG [0, 1], 

L'f 5^, = H{2H -1)J^ e-^"n2-f^-2 du, G (1/2, 1) , 7 G M. 

Consequently, for G (1/2, 1) and 7 G M, 

(2.19) EF{H,-f,l,l) = H{2H -1) f e'^^'u^"-'^ duds. 

Jo Jo 

Particularly note that EF{H,j, 1,1) / for all H G (1/2,1) and 7 G M. 
The integral on the right-hand side of (2.19) can be expressed in terms of 
incomplete F-functions. Direct calculations show that, for G (1/2,1), 

EF{H, 7, 1, 1) ~ £(2^±1) ^ _ 



(2.20) 



EF{H,j,l,l) ^ H{2H -l)\j\-^e^^\ 7^-00 
lim EF{H,-f,l,l) 7GM, 



EF{H,0,l,l) = l 

Particularly, the limit in (2.20) shows that the mapping H 1— > EF{H,^, 1, 1) 
is not continuous at the point 1/2. It would be interesting to extend this 
approach to the bias of hn in the situation of Proposition 2.1 and compare 
the results to known results in the short memory case (Le Breton and Pham 
[17] and Larsson [16]). However, this requires substantial reasoning and will 
be pursued in future work. 

3. Proofs. 

3.1. Proof of Theorem 2.1. First we show that the corresponding nearly 
unstable process converges weakly to the Ornstein-Uhlenbeck process 
driven by Z as defined in (2.7), that is. 



(3.21) ^v^^^Z^, n^oo. 
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We refer to Billingsley's monograph [2] for facts on the Skorohod topol- 
ogy. Without loss of generality we may assume that (3n > for all n € N 
throughout the proof. 

We introduce some auxiliary functions. For n € N, define gn '■ [0, 1] — > M by 
setting gn{s) = s G [0, 1], n G N. With the help of gn, define functions 

/i„:[0,l]2^Mby 

K{s,v)= Pnilog Pn)^r^, 0<s,v<l,nen. 
gn{[sn]/n) 

Recall that lim^^oo n(l — = 7, which implies that lim„^oo nlog,9„ = -7. 
As the exponential function is uniformly continuous on compacts, note that 

(3.22) lim 5„(s) =exp(7s), lim hJs,u) = --ye"^'^'-'''^ 

n^oo n—foo 

uniformly in s, n G [0,1]. 

For n G N and < s < 1, let zi"^ = ^ J2^k=i be the normalized partial 
sum process associated with e, where a = (a„)„gN is the sequence as given in 
(Dl). Let Zy""^ be the Ornstein-Uhlenbeck process driven by as defined 
in (2.7). Observe that, for all n G N and all < / < n — 1, 

(3.23) - n(log/?„) / Zi^^gniu) du = - /?"'). 

Jl/n a-n 

On the other hand, for all n G N, < t < n, note that 

(3.24) ^f^=/?rf^ + E/3*-^^.. 

k=l 

In view of (3.24) and (3.23), adding and subtracting terms, the summation 
by parts formula yields the identity 

(3.25) i-Xg = + R(^\ < s < 1, n G N, 

where, for s G [0, 1] and n G N, we set 

4") = /'(7e-^(^-") + K{s,u))Zi''^ du 
Jo 

+ / hn{s,u)Zi-Uu + 

J[ns\/n angn[[ns\/n) 

By means of (Dl), observe that supo<s<i |.zi'^^ | is bounded in probability 
for n — > 00. Recall that xJ"V CLn = op(l) for n ^ 00. As the limits in (3.22) 
are uniform, we must have that supo<^<]^ =op(l) for n 00. In view 
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of the continuous mapping theorem, we have -i-u for 7 — > 00, giving 
(3.21). 

Now we are in the position to prove Theorem 2.1. Note that the following 
identities hold, that is. 



(3.26) 



Squaring and summing (1.3), we decompose the numerators in (3.26) into 
three terms which we analyze separately in the sequel, that is, for all n G N, 



(3.27) 

t=o 



1 



1 



1 o2 n-1 



We define the auxiliary random variables 



1 



n-l 



t=0 

say, for n € N, where we set 

n-l 



(n)^ _n(l-/?2) 



1 



2/?„ ^2'"+2/?„^^^'") 2/3/^'"' 



As the function / i— > (/(I), /q^ ds) is continuous as a mapping from -D[0, 1] 
into M^, the continuous mapping theorem applies to the limit in (3.21), that 
is, for n oo, 

1 . ^ „ X / .1 



(3.28) 



T2,n 



Z^ „ du 



7i" 



7,1 



Proof of Theorem 2.1(i). Let lim„^oo f^'^^^^n = oo and {e,Z) e 
DA(a). As e satisfies property (D3) in Definition 2.1, this implies T^^n = 
op(l) for n ^ oo. Thus, by definition, 

(3.29) ri,„ = !^il-^r2,„ + -^(r3,„)2 + op(i), n ^ oo. 

Recall that /?„ — > 1 such that n(l — /?„) ^ 7 for n ^ 00. Taking this into 
account, we may plug the weak limit of (3.28) into (3.29) to obtain 



(3.30) 



T2,n 



^[zludu + \zl,^ 



00. 
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As Z satisfies (D2) in Definition 2.1, the same is true for for all 7 € M. In 
particular, we obtain Jq Z^ ,,ds > 0, almost surely. Combining (3.26), (3.27) 
and (3.30), the continuous mapping theorem implies 



7 

where S(Z^) is the vector as defined in (2.6), giving the result. □ 

Proof of Theorem 2.1(ii). Let lim„^oon~^''^an = 1 and {e,Z) e 
DA'(a,cr^) for some cj^ > 0. We note that T„_4 = ct^ + op(l) for n ^ 00 
by property (D3)'. Thus, 

In view of the limit in (3.28), the remaining proof of (ii) is similar to that 
of (i) and is therefore omitted. □ 

Proof of Theorem 2.1(iii). Let lim„^oo''^~^''^o„ = and (e,Z)G 
DA'(a,(T^) for some cr^ > 0. Note that (a^/n)r„,^4 = a"^ + op(l) for n ^ 00 
by property (D3)'. Consequently, by the limit in (3.28), 

^2 I 

— ri,„ = --cj2 + op(l), n^oo. 
n 2 

Applying analogous arguments as in (i), the proof of (iii) is complete. □ 

3.2. Proof of Proposition 2.1. If J2'k^=o'^k finite and, for some b > 
2, (2.13) holds, then X^fc^ol'^fcl finite (cf. Wu [31] for an argument). In 
particularly, is well defined, stationary and ergodic. 

Let J2'k^=o(^k 7^ 0. To prove this proposition, we need to establish condi- 
tions (Dl), (D2) and (D3)' in Definition 2.1. For the choice = E{e^f, 
property (D3)' follows from ergodicity (cf. Brockwell and Davis [3], formulas 
(4.4.3) and (12.4.7) for the identity as given in (2.15)). 

Property (D2) is obvious. In order to show that (Dl) holds, we shall make 
use of Theorem 3.1 of Davidson and de Jong [7]. 

Therefore it suffices to establish their conditions (b)-(d). In view of Jensen's 
inequality, as is finite, note that supj-E|?/f|^ is finite, giving (b) in 
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Davidson and de Jong [7]. For all m € N and t ^"L, observe that 



oo 



k=m+l 



In view of the assumption (2.13), the inequality in the last display implies 
that r] is L2-NED on ^ of size —1/2, giving (c) in Davidson and de Jong 
[7] (cf. de Jong and Davidson [9] for the definition of NED). In view of the 
dominated convergence theorem, it is straightforward to show 



giving (d) in Davidson and de Jong [7]. Consequently, Theorem 3.1 of David- 
son and de Jong [7] applies, that is. 



Combining Lemma 3.1 of Davidson and de Jong [7] and equation (9.3) in 
Doukhan, Oppenheim and Taqqu ([11], page 28), this yields 



where L{H,a) is the quantity given in (2.14), giving the result. 

4. Conclusion. In this paper, asymptotic distributions of the least squares 
estimator of a nearly unstable AR(1) process with long-memory errors are 
derived. It is shown that the limiting distributions behave very differently 
from those in the short-range dependent case, although formal similarities 
can be established. Nevertheless, the results shed light on the trickiness of 
dealing with long-memory models. With these results, we can gather the 
necessary framework to tackle the more challenging problem of a general 
nearly unstable AR{p) model in the spirit of Jeganathan [14]. This will be 
pursued in a forthcoming paper. Finally, the asymptotic theory developed 
here can be used to study the important issue of fractionally cointegrated 
systems in a nearly unstable environment. 
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